Image formation apparatus and method for nuclear imaging

ABSTRACT

An image generating apparatus for image generation is provided. The image generating apparatus includes a movable detector for detecting nuclear radiation during a detection period and an evaluation system. The evaluation system includes an interface system for transmitting detector data to the evaluation system. The detector data include information about the detected radiation for image generation. The evaluation system further includes a data memory portion for storing the detector data. The evaluation system further includes a program memory portion with a program for repeatedly determining at least one quality value with respect to image generation during the detection period.

The present invention relates to image generating apparatuses andmethods for image generation with image generating apparatuses. Specificembodiments of the invention relate to image generating apparatuses forenhanced image generation by means of quality control, instruction to auser for data collection and/or a continuous data collection withenhanced processing. Typical embodiments of the present invention relateto image generating apparatuses and methods for medical purposes.

BACKGROUND

High quality image generation is of great interest for a vast area ofapplications. In particular, in the medical field where the health ofpatient can depend thereon, the best possible image generation isnecessary, for example as a basis for surgery on the patient.

Usually, medical images are generated either pre-operatively orintra-operatively. Also a registration of images is known, for examplethe registration of an anatomical image with a functional image, i.e.,an image that visualizes body activity. Such registered images can forexample help in tumor surgeries to decide which body tissue is to be cutout. Images that are as up-to-date and of as high quality as possibleare desirable because in this way it can be avoided to damage healthytissue or not to remove deceased tissue.

The generation of high quality images poses high demands on detectordata for image generation and on an evaluation system that must processthese data. This is particularly true for processing of detector datawith movable detectors which may for example be hand-held.

Consequently there is a need for an enhanced collection and evaluationof detector data and an enhanced image generation.

SUMMARY

In light of the above, a method for image generation according to claims1 to 92 and an image generating apparatus according to claims 93 to 181are provided.

According to one embodiment of the invention, an image generatingapparatus for image generation is provided. The image generatingapparatus includes a movable detector for detecting nuclear radiationduring a detection period. The image generating apparatus furtherincludes an evaluation system. The evaluation system includes aninterface system for transmitting detector data to the evaluationsystem. The detector data include information about the detected nuclearradiation for image generation. The evaluation system further includes adata memory portion for storing the detector data. The evaluation systemfurther includes a program memory portion with a program for repeatedlydetermining at least one quality value with respect to image generationfrom the detector data during the detection period.

According to a further embodiment of the present invention an imagegenerating apparatus for image generation is provided. The imagegenerating apparatus includes a freely movable detector for detectingradiation during a detection period. The image generating apparatusfurther includes an evaluation system. The evaluation system includes aninterface system for continuously transmitting detector data to theevaluation system during the detection period. The detector data includeinformation about the detected radiation and information about theposition and/or orientation of the detector for image generation. Theevaluation system further includes a data memory portion for storing thedetector data and a program memory portion with a program fordetermining at least one quality value with respect to the imagegeneration from the detector data.

According to a further embodiment of the invention, an image generatingapparatus for image generation is provided. The image generatingapparatus includes a freely movable detector for detection of radiationduring a detection period. The image generating apparatus furtherincludes an evaluation system. The evaluation system includes aninterface system for continuously transmitting detector data for imagegeneration during a detection period. The detector data includeinformation about the detected radiation. The detector data furtherinclude information about the position and/or orientation of thedetector. The evaluation system further includes a data memory portionfor storing detector data. The evaluation system further includes aprogram memory portion with a program for determining at least onequality value with respect to image generation from the detector data.

According to a further embodiment of the invention, an image generatingapparatus for image generation is provided. The image generatingapparatus includes a movable detector for detecting radiation. The imagegenerating apparatus further includes an evaluation system. Theevaluation system includes an interface system for transmitting detectordata for image generation to the evaluation system. The detector datainclude information about the detected radiation. The detector datafurther include information about the position and/or orientation of thedetector. The evaluation system further includes a data memory portionfor storing detector data. The evaluation system further includes aprogram memory portion with a program for determining an imagegeneration rule for image generation on the basis of the collecteddetector data, taking into account a detection model. The detectionmodel takes into account a material property of a material influencingthe detection and/or a constraint.

According to a further embodiment, an image generating apparatus forimage generation is provided. The image generating apparatus includes amovable detector for detection of radiation. The image generatingapparatus further includes an evaluation system. The evaluation systemincludes an interface system for transmitting detector data for imagegeneration to the evaluation system. The evaluation system furthercomprises a program memory portion with a program for registeringdetector data with compatible data.

According to a further embodiment, an image generating apparatus forimage generation is provided. The image generating apparatus includes amovable detector for detection of nuclear radiation during a detectionperiod. The image generating apparatus further includes an evaluationsystem. The evaluation system includes an interface system fortransmitting detector data for image generation to the evaluationsystem. The detector data include information about the detected nuclearradiation. The evaluation system further includes a data memory portionfor storing detector data. The evaluation system further includes aprogram memory portion with a program for determining an imagegeneration rule on the basis of the collected detector data. Theevaluation system further includes a program memory portion with aprogram for repeatedly modifying the image generation rule on the basisof at least one quality value during the detection period.

According to a further embodiment, a method for image generation bymeans of an image generating apparatus is provided. The method includesdetecting nuclear radiation by means of a movable detector during adetection period. The method further includes collecting detector datafor image generation by means of an evaluation system of the imagegenerating apparatus. The detector data include information about thedetected radiation. The method further includes repeatedly determiningat least one quality value from the collected detector data by means ofthe evaluation system during the detection period and outputting aninstruction to a user for further moving the detector in dependence ofthe collected detector data and/or of the at least one determinedquality value, wherein the instruction relates to at least a part of theremaining detection period.

According to a further embodiment a method for image generation by meansof an image generating apparatus is provided. The method includesdetecting radiation by means of a freely movable detector of the imagegenerating apparatus during a detection period, and changing positionand/or orientation of the detector during the detection period. Themethod further includes continuously collecting detector data for imagegeneration by means of an evaluation system of the image generatingapparatus during the detection period. The detector data includeinformation about the detected radiation and information about theposition and/or orientation of the detector. The method further includesdetermining at least one quality value from the collected detector databy means of the evaluation system.

According to a further embodiment, a method for image generation bymeans of an image generating apparatus is provided. The method includesdetecting radiation by means of a movable detector of the imagegenerating apparatus during a detection period. The method furtherincludes changing the position and/or orientation of the detector duringthe detection period. The method further includes continuouslycollecting detector data for image generation by means of an evaluationsystem of the image generating apparatus during the detection period.The detector data include information about the detected radiation. Thedetector data further include information about the position and/ororientation of the detector. The method further includes determining atleast one quality value from the collected detector data by means of theevaluation system.

According to a further embodiment, a method for image generation bymeans of an image generating apparatus is provided. The method includesdetecting radiation by means of a detector of the image generatingapparatus. The method further includes collecting detector data forimage generation by means of an evaluation system of the imagegenerating apparatus. The detector data include information about thedetected radiation. The detector data further include information aboutthe position and/or orientation of the detector. The method furtherincludes determining an image generation rule by means of the evaluationsystem for image generation on the basis of the collected detector data,taking into account a detection model. The detection model takes intoaccount a material property of a material influencing the detectionand/or a constraint.

According to a further embodiment, a method for image generation bymeans of an image generating apparatus is provided. The method includesdetecting radiation by means of a detector of the image generatingapparatus. The method further includes collecting detector data of thedetector for image generation by means of the evaluation system of theimage generating apparatus. The method further includes registering thedetector data with compatible data by means of the evaluation system.

According to a further embodiment, a method for image generation bymeans of an image generating apparatus is provided. The method includesdetecting nuclear radiation by a movable detector of the imagegenerating apparatus during a detection period. The method furtherincludes collecting detector data for image generation by means of anevaluation system of the image generating apparatus. The detector datainclude information about the detected radiation. The method furtherincludes determining an image generation rule by means of the evaluationsystem on the basis of the collected detector data. The method furtherincludes repeatedly modifying the image generation rule on the basis ofat least one quality value during the detection period.

Further features, aspects, and details which can be combined withembodiments described herein are disclosed in the dependent claims, thedescription and the drawings.

SHORT DESCRIPTION OF THE FIGURES

So that the above features can be better understood in detail, a morespecific description is given with reference to embodiments of theinvention. The appended drawings relate to embodiments of the inventionand will be described shortly in the following.

FIG. 1 shows a schematic arrangement of an image generating apparatusaccording to embodiments of the invention;

FIG. 2 shows a detector system of the image generating apparatusaccording to embodiments of the invention;

FIG. 3 shows a detection system of the image generating apparatusaccording to embodiments of the invention;

FIG. 4 shows a schematic arrangement of an evaluation system of theimage generating apparatus according to embodiments of the invention;

FIG. 5 shows a schematic arrangement of program memory portions of theevaluation system according to embodiments of the invention;

FIG. 6 shows an output system of the image generating apparatusaccording to embodiments of the invention;

FIG. 7 shows a further output system of the image generating apparatusaccording to embodiments of the invention;

FIG. 8 shows a guiding system of the image generating apparatusaccording to embodiments of the invention;

FIG. 9 shows an image generating apparatus according to embodiments ofthe invention at use in the medical field;

FIG. 10 shows the generation of a detection model according toembodiments of the invention;

FIG. 11 shows the generation of a detection model via measurementsaccording to embodiments of the invention;

FIG. 12 shows a quality control process according to embodiments of theinvention;

FIG. 13 shows an iterative flow diagram with a step of instructing auser according to embodiments of the invention;

FIG. 14 shows a detection process with a freely movable detectoraccording to embodiments of the invention.

DETAILED DESCRIPTION

In the following detailed reference is made to various embodiments ofthe invention, of which some are exemplarily illustrated by thedrawings. Each example is provided by means of explanation and for abetter understanding of the invention and shall not be construed aslimiting the invention. Thus, features which are described with respectto one embodiment, or are being illustrated with respect to oneembodiment, can be combined with other embodiments to generate furtherembodiments. It is intended that such modifications and variations areencompassed.

In particular, embodiments of the invention are mostly described, for abetter understanding, with respect to image generation for medicalpurposes. However, many of the embodiments can also be used for imagegeneration in other fields.

Within the following description and in the drawings the same referencesigns relate to the same or similar components. Generally, only thedifferences between individual embodiments are explicitly described.

The expression “detection period” used herein denotes a period betweenthe beginning of a first detection process and the end of last detectionprocess. The first and last detection process can be identical such thatthe detection period is a period during which a detection processcontinuously takes place. The first and last detection can also bedifferent. In a detection period other processes can therefore lie. Forexample, such other processes can be data evaluation processes. The atleast one detection process taking place in the detection period iscarried out by the same detector, respectively detector system, on thesame object. An example for a detection period is the period between thefirst measurement of nuclear radiation with a gamma probe on a patientand the last measurement, wherein for example after the last measurementa final image with the visualization of body functions can be generated.Between the first measurement and the last measurement there can also beone or several measurement pauses, for example for data evaluation oreven for measurement on another object. A detection period would forexample not be defined by a first measurement only on the back of apatient and by a further measurement only on the stomach of the patient.

Specifying that an action is carried out “during a detection period” (ormore generally during any period) is not to be construed in the sensethat the action needs to fill the full period. The action can also onlytake place during part of the detection period. The action can also beinterrupted.

The expression “freely movable” is generally understood in that theposition and/or orientation of an object which is freely movable can bechanged substantially arbitrarily. For example, a detector which ishandheld is a freely movable detector. Also, a detector which is mountedto a robot arm with sufficiently many degrees of freedom is freelymovable, wherein the robot arm is for example controlled by a user. Adetector which is movable along a rail is movable but not freelymovable.

The expression “continuous” includes, when relating to an action such as“continuously collecting detector data”, an ongoing or regularlyrepeated action. The temporal distances between the regular repetitionscan in principally in principal be arbitrarily short, i.e.quasi-continuous. However, it is obvious for the skilled person that,for example, physical constraints can limit arbitrarily short distances.For example, detectors can have so-called “dead times” such that duringsuch dead times no detection can take place. Consequently, also duringe.g. a continuous collection of the detector data, a regular repetitionof data collection within the collection process may not be possiblewithin time intervals that are shorter than said dead times. The notion“continuous” includes, when used in relation to an action, also therepetition or the iterated repetition in arbitrarily short timeintervals. Also arbitrarily selected time intervals can, in principle,be arbitrarily shortly following each other, and limitations asexplained above apply analogously.

The “generation of an image” includes the generation of image datawithout the need for output of such image data to an output unit, forexample a monitor.

FIG. 1 shows an image generating apparatus 1 according to embodiments ofthe invention. As shown in FIG. 1, the image generating apparatus 1includes a detector system 100. The detector system 100 includes atleast one detector 110. The image generating apparatus further includesan evaluation system 300. The evaluation system 300 includes at leastone memory unit 310 and at least one processing unit 350. In someembodiments the detector system and the evaluation system are linked bya data exchange system 20. According to further embodiments, the imagegenerating apparatus includes a tracking system 200 as shown in FIG. 1.The tracking system 200 includes at least one tracking unit 210. Infurther embodiments the image generating apparatus includes an outputsystem 400. The output system includes at least one output unit 410. Insome embodiments, the tracking system 200 and the output system 400 areconnected to the evaluation system 300 by means of a data exchangesystem. In further embodiments the image generating apparatus includes aguiding system 500. The guiding system 500 includes at least one guidingunit 510. The guiding system can be connected to the evaluation systemby means of a data exchange system. The individual systems are describedin more detail in the following.

Detector System 100

According to embodiments of the invention, the detector system 100includes a detector 110. In typical embodiments, the detector 110 is aradiation detector, typically a detector for nuclear radiation.According to some embodiments the detector is movable, according tospecific embodiments even freely movable. In typical embodiments thedetector is handheld. The detector can be a gamma radiation probe, abeta radiation probe, a Compton probe, a gamma radiation camera, a gammaradiation mini camera, a beta radiation camera or a Compton camera. Thedetector can also be a detector for optical radiation, a detector forinfrared radiation, x-rays or a detector for other kinds of radiation orany other kind of detector.

Detector data can include information about the detected radiation. Thedetector data can be formatted to a certain degree but generally theassociation of single data sets to specific detection events or at leastto a group of detection events should be possible. The detector data canalso include position and/or orientation of the detector. Detector datacan further include other data.

In some embodiments, the detector system 100 includes at least onefurther detector. The at least one further detector can be similar tothe detector 110 or identical in built. The at least one furtherdetector can also be of a different kind as compared to detector 110.The at least one further detector can, for example, be an ultrasonicprobe, an x-ray detector, an optical camera, an optical microscope, afluorescence camera, an auto-fluorescence camera, a magnetic resonancetomography detector, a positron emission tomography detector, short PET,a single photon emission computer tomography detector, short SPECT, oranother kind of detector.

FIG. 2 shows a detector system 100 according to embodiments of thepresent invention. In FIG. 2, two detectors 110, 120 of the detectorsystem 100 are shown: a probe 110 for detecting nuclear radiation and anoptical camera 120. The nuclear radiation can for example be gamma,beta, Compton, x-ray, or alpha radiation. Further, a nuclear radiationsource 10 that is to be detected is shown. A radiation source cangenerally be, here and in the following, a spatially distributedradiation source, i.e. a spatial radiation distribution. A radiationsource can also be a substantially two dimensional radiation source,i.e. a radiation distribution that is substantially plane.

The detectors can be handheld as shown and be movable and orientable inthe three spatial directions, i.e. freely movable. Further, thedetectors 110, 120 each have a cable for power supply and for dataexchange, e.g. with the evaluation system 300 shown in FIG. 1. Further,the detectors 110, 120 each have markings for tracking by the trackingsystem 200 shown in FIG. 3, as further described below with respect toFIG. 3. There can also be a tracking system 200 that works withoutmarkings.

Detector data, such as detector data with information about measuredradiation, can be provided to the evaluation system 300 (see FIG. 1). Inparticular, the evaluation system 300 can collect the detector data.

Tracking System 200

According to some embodiments, the image generating apparatus includes atracking system 200. According to some embodiments, the tracking system200 includes a tracking unit 210. The tracking unit can be an optical,electromagnetic, mechanical, robot-based, radio wave-based, soundwave-based, goniometer-based, potentiometer-based, gyroscope-based,acceleration sensor-based, radiation-based, or x-ray-based detectionunit, or an infrared or white light detection unit or another kind ofdetection or tracking unit. According to further embodiments, thetracking system 200 includes a further tracking unit 220 or furthertracking units. The tracking unit 220 or the further tracking units canbe tracking units as the ones listed above or can be other trackingunits. To guarantee feasibility or reliability of the tracking system,some embodiments have at least two, at least three or at least fourtracking units.

FIG. 3 shows a tracking system 200 according to typical embodiments ofthe present invention. FIG. 3 shows two optical tracking units 210 and220. The optical tracking units 210 and 220 detect markings 112 on theprobe of nuclear radiation 110 and markings 122 on the optical camera120. The optical tracking units 210 and 220 generate, by detecting themarkings 112 and 122, data with information about the position and/ororientation of the probe 110 and the camera 120. In the example shown inFIG. 3, the optical tracking units 210 and 220 are exactly calibrated,and the position and orientation of probe 110 and of the camera 120 isbeing determined by detecting the position of the markings 112, and 122respectively, by means of known triangulation methods.

Data of the tracking systems, such as detector data with informationabout the position and orientation, can be provided to the evaluationsystem 300. In particular, the evaluation system 300 can collect suchand other detector data.

Evaluation System 300

According to embodiments of the present invention, the evaluation system300 includes a memory system 302 with a memory unit 310. The memory unit310 can for example be a computer hard drive or another mass storagedevice, or can be of a different kind. According to embodiments of theinvention, the storage unit 310 includes a data storage portion 320. Thedata storage portion 320 can for example be used for storing detectordata. The data storage portion 320 can also be used for storing otherdata. According to embodiments, the storage unit 310 includes a programstorage portion 330. The program storage portion 330 as well as furtherprogram storage portions according to further embodiments will bedescribed further below. The data storage unit 310 can include furtherdata storage portions and further program storage portions. Thedifferent storage portions need not physically or in a memory-technicalsense form a unit; different portions are rather distinguished only withrespect to the nature of the data stored or to be stored therein. Thememory system 302 can include further memory units. The further memoryunits can be similar to memory unit 410 or of a different kind.

According to further embodiments, the evaluation system 300 includes aprocessing system 304. The processing system 304 includes a processingunit 350 according to some embodiments. The processing unit 350 can forexample be the computing part of a computer, for example a processor.According to further embodiments the processing system 304 includesfurther processing units, which can be similar to the processing unit350 or be of a different kind. In particular, at least one processingunit and at least one memory unit can be integrated in special devices,such as commercially available computers.

According to further embodiments, the evaluation system includes aninterface system 306. In some embodiments the interface system 306includes a detector system interface 306 a with a detector interface 380for data exchange with a detector, for example with the detector 110. Infurther embodiments the interface system 306 includes a tracking systeminterface 306 b with a tracking unit interface 390 for data exchangewith a tracking system (for example, the tracking system 200 of FIG. 3).An interface system 306 or parts thereof can also be integrated inspecial devices, such as commercially available computers. In someembodiments, the evaluation system communicates with other partialsystems of the image generating apparatus via such interface systems bymeans of a data exchange system.

In further embodiments of the invention, the program memory portion 330includes a program. As shown in FIG. 5, the program can for example be aprogram 330 for determining at least one quality value on the basis ofdetector data. In other embodiments, a memory unit includes furtherprogram memory portions, for example further program memory portions 332and 334 with program 332 a for determining an image generation rule onthe basis of detector data while taking into account a detection model,and respectively with a program 334 a. Program 334 a includes programpart 334 b for determining at least one quality value on the basis ofdetector data and program part 334 c for repeatedly determining at leastone quality value on the basis of detector data.

In particular, programs, which for example carry out similar functions,can also be formed as program parts of a single program, as for exampledescribed above for program 334 a. The same is also true forfunctionally different programs. In both cases, the first programportion with a first program and a second program portion with a secondprogram are identical, and the first and second program are consideredas parts of a single program.

In further embodiments, in which a first program portion with a firstprogram and a second program portion with a second program are provided,the first program portion can be identical to the second program portionas well as the first program to the second.

Output System 400

With reference to FIG. 6, the image generating apparatus includes anoutput system 400 according to further embodiments. The output system400 includes an output unit 410 according to some embodiments. Theoutput unit 410 can be a visual, acoustical or haptic output unit or acombination form thereof. In some embodiments, the output unit 410 is anoutput unit for displaying images or an instruction to a user. A user isusually a human being. Alternatively, a user can also be a differentliving being or an inanimate object, for example a machine.

In further embodiments, the output system 400 includes further outputunits. These can be of similar kind as the output unit 410 or of adifferent kind.

Output units according to embodiments of the present invention candisplay reality, display a virtual reality or display an augmentedreality. An output unit of an augmented reality can for example combinea real image with virtual images.

According to embodiments of the invention, an output unit can, amongothers, be one of the following: monitor, optically transparent monitor,stereo monitor, head-mounted stereo displays, acoustical frequency-codedfeedback systems, acoustical pulse-coded feedback systems,force-feedback joysticks or force-torque-feedback joysticks or otherkinds of visual, acoustical and/or haptic output units or combinationsthereof.

FIG. 6 shows an output unit 410 according to embodiments of the presentinvention. In FIG. 6, the output unit 410 is an optical output unit, inparticular a monitor. FIG. 6 shows further an acoustical output unit420. In FIG. 6, the acoustical output unit is a loudspeaker.

FIG. 7 shows a further output unit 430 in form of a head-mounted visualdisplay.

Guiding System 500

In further embodiments, the image generating apparatus includes aguiding system 500, as for example shown in FIG. 8. According to someembodiments, the guidance system 500 includes a guiding unit 510. Aguiding unit 510 can for example guide an object by means of a robotarm. The guiding unit 510 can also guide a user. Guiding can also berobot-based or else can rely upon optical, acoustical or haptic signalsor on combinations thereof. The guiding unit 510 shown in FIG. 8 guidesthe user by haptic signals. In FIG. 8, the guiding unit 510 serves forbetter guiding a surgical instrument 40 during surgery on a body 30. Theguiding unit may for example provide a resistance, be it by mechanicalhindrance or by stimulation of the muscles by means of electricalpulses.

The guiding unit 510, or further guiding units, can also be formed byoutput units of the output system if the guidance of the user iseffected by a corresponding output. The guiding system 500 can thereforebe identical with the output system 400.

In further embodiments, the image generating apparatus includes a dataexchange system. As shown in FIG. 1, the data exchange system serves forexchanging data between systems of the image generating apparatus, forexample for exchange of data between detector system and evaluationsystem, between tracking system and evaluation system, between outputsystem and evaluation system, or between guiding system and evaluationsystem (as shown in FIG. 1 by means of corresponding connection lines).The data exchange system can rely upon interfaces such as the detectorinterface 380 or the tracking system interface 390, according to someembodiments. Generally, the exchange of data can take place by aconnection of the systems by means of cables or else wireless or in anyother way.

FIG. 9 shows, according to embodiments of the invention, a body part ofa human or other living being, into which radioactive substances havebeen injected, so-called tracers, which accumulate in certain preferredregions and are stuck there. The regions or spatial areas in which theradioactive substances are accumulated, respectively are stuck, can beregarded as closed regions which include a source of nuclear radiation.

FIG. 9 further shows a detector for nuclear radiation 110. The detector110 measures the nuclear radiation that emerges from the source withinthe body. Further, FIG. 9 shows a laparoscope 120 which gathers data forgenerating an optical image of the interior of the body. The datagathered by the detector for nuclear radiation 110 and the laparoscope120 are collected in the evaluation system (not shown) and areprocessed. Further, the position and/or orientations of the twodetectors are tracked via markings 112 and 122, and corresponding datais collected by the evaluation system. From all these data, theevaluation system generates, with the help of an image generation rule,an optical image of the interior of the body based on data of thelaparoscope as well as a functional image, that visualizes bodyfunctions such as metabolism, based on the data of the detector fornuclear radiation. The image can in particular be three dimensional.

On an output unit 410, the optical anatomic image and the functionalimage are overlaid and, for example, displayed three dimensionally. Theoverlay is generated on the basis of a registration of the optical imagewith the anatomic image by means of the evaluation system.

Further, FIG. 9 shows a surgical instrument 40 the position and/ororientation of which are also tracked. The gathered data of the surgicalinstrument are also processed by the evaluation system. In this way, animage of the surgical instruments and of their location in the interiorof the body can be determined by the evaluation unit. This image canalso be registered with the anatomic and optical image and be displayedon the output unit 410. If, in particular, the functional image is highquality and up-to-date and if the registration with the optical imageand the instrument image is good, the output of the registered images onthe output unit enables a surgeon to precisely control the surgery.

The images of known image generating apparatuses and of correspondingmethods for image generation are, however, oftentimes images used insurgery, but which are not up-to-date.

This applies for example to pre-operative images, since the taking ofwhich the tissue and its functions may already have undergone change. Ifintra-operative images are used, problems oftentimes result inparticular when using movable detectors, because then known evaluationsystems are not capable of guaranteeing a high quality image. To enhanceimage generation there is a need of quality control, in particular aquality control already during the gathering of detector data. Suchquality control can also be a continuous quality control. Further, forenhancing image generation, an enhanced data set is desirable, which canbe insured by giving instructions for detection. In particular, withmovable or even handheld detectors, the gathering of detector data whichcan in principle take place at any moment and with any arbitraryposition and/or orientation of the detector, poses a challenge. Forenhancing image generation, it is further desirable to use existinginformation, for example about anatomic facts, detector properties,other material properties which may influence the detection, or aboutconstraints. Also an enhancement of registration of the images cancontribute to enhance image generation. Changing an enhancing theimaging rule already during the detection period can also enhance imagegeneration overall.

According to embodiments of the invention, means for enhancing imagegeneration are provided.

Collecting Detector Data

According to embodiments of the present invention, detector data arecollected by the evaluation system. Therein, position and/or orientationof the detector can have been tracked by a tracking system. The detectordata include information about the detected nuclear radiation, accordingto some embodiments. In further embodiments, the detector data includeinformation about the position and/or orientation of the detector. Forexample, data with information about the detected radiation can besynchronized with data about the position and/or orientation of thedetector and be collected in synchronized form. With respect tosynchronization of data, see WO 2007/131561, in particular page 3, lines1 to 6 and lines 27 to 32, and page 6, lines 22 to 30, in corporateherein by reference. The WO 2007/131561 is further included herein byreference in its entirety. In further embodiments, the detector data arestored in the evaluation system.

In further embodiments, a detector detects radiation during a detectionperiod. This radiation can be radioactive, respectively nuclearradiation. Nuclear radiation is also to be understood as radiation whichis indirectly generated by radioactive decays, for example ionizationradiation of an alpha particle. Embodiments of the invention in whichthe detector measures nuclear radiation hence also include detecting ofsuch secondary radiation.

Image Generation and Image Generation Rule

In further embodiments, the evaluation system generates an image fromthe detector data by means of an image generation rule. In typicalembodiments, this image is an image of the radiation distribution andthus of the radiation sources in a spatial region.

According to further embodiments, the image generation rule is a linearrule. Therein, an imaging matrix H, also called system matrix, istypically applied to a vector f=(f₁, f₂, . . . f_(N)). The vector fcontains image information. Typically, for visualizing an image of aspatial region, this spatial region is divided into image elements(voxel). Each index i=1, 2, . . . , N of the vector f is then associatedwith a particular image element. Information elements with respect tothese image elements (for example the intensity of radiation in thecorresponding image element) form the entries f_(i) of the vector f to acorresponding index i.

The detector data are also collected in a vector g=(g₁, g₂, . . . ).Each index k=1, . . . , M is thereby associated to a measurement (or anaveraged series of measurements, see below) of a detector, and the entryg_(k) contains the result of the intensity of radiation measured duringthis measurement.

The entries H_(ki) of the imaging matrix H model the influence of anormalized radiation source at the position belonging to the index ionto the k^(th) measurement. The imaging matrix H contains, in itsentries H_(ki), information about positions and orientations of thedetector for nuclear radiation. As the different contributions linearlysuperpose, a result of the measurement with a radiation distributionf_(i) is to be expected which is approximately given by the vectorg_predicted_(k)=Σ_(i)H_(ki)f_(i). In matrix notation (with “*” as matrixproduct):

g_predicted=H*f

Such a vector g_predicted can be compared to a vector g_measured whichcontains the actual detector data with information about the detectedradiation. In this comparison, different measurement errors, for examplecontributions of external radiation sources, imperfections of thedetector, statistical errors, etc. are to be taken into account.

The image generation can now be described in a way that a vector f withdata information regarding the radiation distribution in a spatialregion shall be found that best corresponds to the actually measureddata about the nuclear radiation. For this, a conceptual ansatz is theminimization of the distance

|H*f−g_measured|,

over all estimated radiation distributions the image information ofwhich is coded into a respective vector f. Therein, |•| denotes asuitable distance norm. In typical embodiments, |•| is computed as theL₂ norm. This minimization can also be implemented as an iterativeprocess. The involved minimization process can be carried out forexample by algebraic reconstruction techniques, maximum likelihoodexpectation value maximization, pseudo inversion by means of singularvalue decomposition, Gauss-Seidel inversion, successive over-relaxation,Jacobi inversion, multiplicative algebraic reconstruction techniques,simultaneous iterative reconstruction techniques or by other techniques.Also, regularization methods such as Tikhonov regularization, totalvariation regularization and other regularizations can be used. In lightof this, the image generation rule is defined, in the first line, by thematrix H. But, also the algorithm to be used for solving theminimization problem as well as the starting vector to be used in aniterative solution are part of the image generation rule.

In further embodiments, the image generation rule is non-linear. Alsofor such a non-linear image generation rules, analogous methods can beapplied.

Detection Models

According to embodiments, image generation rules, in particular thematrix H described above can be generated or enhanced on the basis of atleast one detection model. Detection models can be changed or adapted,in particular on the basis of new detector data. According to someembodiments, detection models can be enhanced or be continuouslyenhanced. Enhanced or continuously enhanced detection models can be usedfor enhancing an image generation rule.

With a linear image generation rule according to embodiments of thepresent invention the entries of the imaging matrix can be calculatedwith the help of detection models. Such detection models can begenerated by algebraic, analytic, numeric, or statistical methods, or onthe basis of measurement data or by combinations thereof. In someembodiments, detection models are generated by measurements on aradioactive point source which is positioned differently and theradiation of which is measured from different positions andorientations. By such measurements or by suitable detection models,information is gained about for example at least one material propertyof at least one material, or such information is used. In the case ofimage generation for medical purposes, material properties of materialsdistributed in space can be determined, such as operation table,instruments, but also the patient himself.

Material properties include the attenuation between source and detector,the scattering between source and detector, the material properties ofmaterials between source and detector, the attenuation by a detectorshield or the scattering by a detector shield, the attenuation in thedetector itself and the scattering in the detector itself.

Further, analytic, algebraic, numerical, or statistical models, ormodels that are combinations thereof, can also take into accountconstraints besides material properties. Examples for constraints arethe relative solid angle between a detector and a source area ofradiation, the dimensions of the detector or the absence of material ormatter. Constraints allow to exclude certain image vectors f from thestart, and to thereby obtain better results of the optimization problemsdescribed above.

FIG. 10 schematically shows the mapping of real objects and of a realdetection process onto a detection model and a simulated detectionprocess. According to embodiments of the invention, real objects such asa detector 110, a body 30 and a source of radiation 10 within the bodyare mapped to data of a detection model. Therein, data with respect to adetector describe a virtual detector 110 a, data with respect to thebody describe a virtual body 30 a, and data with respect to theradiation source describe a virtual radiation source 10 a.

FIG. 11 illustrates the determination of a detection model on the basisof measurements. A radioactive point source 50 emits nuclear radiation52 in all spatial directions. A detector 110 measures the radiationsource 50 at different positions and with different orientations (secondposition/orientation is depicted with dashed lines), whereby informationabout material properties are gained. Material properties can forexample include those of the body 30. From the measurement data, adetection model can be determined. The detection model can take intoaccount the information of the measurement data and further information,such as for example the detector geometry.

According to embodiments of the present invention, a method for imagegeneration by means of an image generating apparatus is provided. Themethod includes detecting radiation by means of a detector of the imagegenerating apparatus. The radiation may be nuclear radiation. Detectingcan take place during a detection period. The method further includescollecting detector data for image generation by means of an evaluationsystem of the image generating apparatus. In typical embodiments, thedetector data include information about the detected radiation. Infurther typical embodiments, the detector data include information aboutthe position and/or orientation of the detector. The method furtherincludes determining an image generation rule by means of the evaluationsystem for image generation on the basis of the collected detector data,taking into account a detection model. In typical embodiments, thedetection model takes into account a material property of a materialinfluencing the detection and/or of a constraint.

According to further embodiments, the detector is movable. According tofurther embodiments, the detector is freely movable. In furtherembodiments, the detector is handheld. In typical embodiments, themethod includes again, repeatedly, or continuously collecting detectordata for image generation by means of the evaluation system of the imagegenerating apparatus, typically during a detection period.

In some embodiments, the method further includes determining at leastone quality value from the collected detector data by means of theevaluation system. In further embodiments, the method includes again orrepeatedly determining at least one quality value form the collecteddetector data by means of the evaluation system. Typically, determining,again determining, repeatedly determining, or continuously determiningtakes place during a detection period.

In particular, the detection model according to embodiments of theinvention can be generated algebraically, analytically, numerically,statistically, or on the basis of measurement data, or by combinationsthereof.

In further embodiments, the detection model takes into account at leastone further material property and/or at least one further constraint.Material properties can for example influence the detection modelbecause of the following effects: attenuation of radiation, scatteringof radiation, refraction of radiation, diffraction of radiation,influence of electromagnetic fields, influence of background radiation,signal noise, or influence of errors in the measurement values of thedetector as well as in measurements of position and/or orientation ofthe detector. Embodiments of the invention can include detection modelsthat take into account these and other effects.

Methods for image generation according to embodiments of the inventioncan also take into account at least one constraint, wherein theconstraints can for example be the relative solid angle between thedetector and the source region of radiation, the dimensions of thedetector or the absence of material.

According to further embodiments, an image generating apparatus forimage generation is provided. The image generating apparatus includes adetector for detection of radiation. The detector can be a movabledetector. The detector can be a freely movable detector. The detectorcan be a handheld detector. The radiation can be nuclear radiation. Theimage generating apparatus further includes an evaluation system. Theevaluation system includes an interface system for transmitting detectordata for image generation to the evaluation system. Typically, detectordata include data with information about the detected radiation.Typically, the detector data also include data with information aboutthe position and/or orientation of the detector for image generation.The evaluation system further includes a data memory portion for storingdetector data. The evaluation system further includes a program memoryportion with a program for determining an image generation rule forimage generation on the basis of the collected detector data, takinginto account a detection model. In typical embodiments, the detectionmodel takes into account at least one material property of at least onematerial influencing the detection and/or at least one constraint.

In further embodiments, the interface system is an interface system fortransmitting detector data to the evaluation system. Therein, thedetector data typically include information about the detectedradiation. Typically, the data also include information about theposition and/or orientation of the detector. According to furtherembodiments, the interface system is an interface system forcontinuously transmitting detector data to the evaluation system forimage generation. The detector data can again include information aboutthe detected radiation and/or information about the position and/ororientation of the detector. Typically, the transmission is atransmission during the detection period.

According to further embodiments, the detection model takes into accountan attenuation of radiation, a scattering of radiation, a refraction ofradiation, a diffraction of radiation, the influence of electromagneticfields, the influence of background noise, a signal noise, the influenceof errors in the measurement data of the detector and in the measurementof position and/or orientation of the detector or further effects. Inyet further embodiments, the detection model takes into accountconstraints such as the relative solid angle between the detector and asource region of radiation, the dimension of the detector or the absenceof a material or combination of these constraints.

According to further embodiments image generation rules are modified. Inparticular, with linear image generation rules, the entries of theimaging matrix or system matrix are modified. In typical embodiments,the system matrix is modified as soon as further measurement data areavailable. Specifically, the minimization of the norm of the differencebetween H applied to f and a g_measured can be minimized again as soonas further measurement data are available. Consequently, embodimentstypically include a continuous modification of the image generationrule. Also, detection models can continuously be adapted and enhanced.

Registration

According to further embodiments, detector data are registered withcompatible data. In some embodiments, a compatible data are gained by animaging rule from the given image. Such an image can for example be ananatomical or body-functional image that was taken beforehand(pre-operatively taken). In the case of a linear imaging rule, this canbe described by an imaging matrix H as described above. The matrix H candepend on a location vector T, in which information about the relativelocation and/or orientation between the detector and the source ofradiation is included. Therein, T can describe a relative location inthe sense of a rigid registration or in the sense of a deformableregistration. The matrix H(T), i.e. dependent on T, is applied to avector f_(image) as described above to obtain a vector with(theoretical) detector data g=H(T)*f_(image) associated with the image.

The information contained in g represents predicted or virtual orsimulated detector data which are called simulation detector data. Asbefore, the vector g_(measured) contains information about detectedradiation. The format (i.e. the structure of the vector g) of thesimulation detector data is compatible with the measured detector datag_(measured). A registration of detector data with such compatible datatakes place, according to some embodiments of the invention, in that thedistance |H(T)*f_(image)−g_(measured)| is minimized, i.e. between g andg_(measured). The distance |•| can for example be given by the L₂ norm.The minimization takes place overall location vectors T to obtain, as aresults of the minimization, an optimal location vector T. By using thisoptimal location vector T, an image vector is associated to the measureddetector data by the matrix H(T), the image vector being compatible withthe image vector of the given image and being registered.

In typical embodiments the minimization is carry out by algorithms suchas the best-neighbour ansatz, a simplex-optimizer, theLevenberg-Marquardt algorithm, the steepest gradient decent, theconjugate gradient decent, or others.

The registration not only can take place by comparing the detector datag as described above, but also by direct comparison of the image data fgained from the detector data with a given image. This comparison can becarried out by an image comparison with the methods described above withrespect to g, or else by a comparison of single marking pointsdesignated for this purpose. Also, other registration methods arepossible.

The image comparison described above further allows obtaining anestimation of the quality of the collected data (as deviation betweenthe image data gained from the detector data and the given image).

Data can be indirectly registered with compatible data also. Indirectregistration is to be understood as a registration of a first data setwith a third data set by means of a second data set. To this end, thefirst data set is registered with a second data set, for example asdescribed above. Then the second data set is registered with a thirddata set. By using this registration the first data set is finallyregistered with a third data set. For example, the first data set canhave been gained from a base image such as an anatomical image takenpre-operatively. The second data set can for example correspond todetector data of a first instance in time, and a third data set todetector data of a later instance in time. If the registration betweenthe first data set, derived from the base image, and the second data sethas been successful, the similarity between the second and third dataset, consisting of detector data, simplifies a registration if indirectregistration is used as described above.

In further embodiments, a method for image generation by means of animage generating apparatus is provided. The method includes detectingradiation by means of a detector of the image generating apparatus.Detecting can take place during a detection period. The radiation can benuclear radiation. The detector can be movable. The detector can befreely movable. The detector can be handheld. The method furtherincludes collecting detector data for image generation by means of theevaluation system of the image generating apparatus. Typically, thedetector data include information about the detected radiation.Typically, the detector data also include information about the positionand/or orientation of the detector. The method further includesregistering the detector data with compatible data by means of theevaluation system. In further embodiments, the compatible data aredetector data. According to further embodiments, the method for imagegeneration includes generating simulation detector data based on a baseimage by means of the evaluation system. The compatible data can besimulation detector data. In further embodiments, at least onecomparison function is used for registering the detector data.

In further embodiments, the method includes an indirect registration ofsimulation detector data with detector data by means of secondcompatible data. In some embodiments, the second compatible data aredetector data. In other embodiments, the second compatible data aresecond simulation detector data based on a second base image.

Comparison functions can for example be cross correlation,trans-information, block entropies, cross correlation rates, cosinemeasure, extended Jaccard similarity, ratio image uniformity, sums ofsquared distances or sums of absolute values of distances, or furthercomparison functions.

In further embodiments, the base image is an anatomical orbody-functional image. In other embodiments, the second base image is ananatomical or body-functional image. Anatomical images can for examplebe a computer tomography, a magnetic resonance tomography, an ultrasonicimage, an optical image, or an x-ray image. Body-functional images canfor example be a positron emission tomography, short PET, a singlephoton emission computer tomography, short SPECT, or an opticaltomography.

In further embodiments, an image generating apparatus for imagegeneration is provided. The image generating apparatus includes adetector for detecting radiation. The detector can be movable. Thedetector can be freely movable. The detector can be handheld. Theradiation can be nuclear radiation. The detector can be a detector fordetecting during a detection period. The image generating apparatusfurther includes an evaluation system. The evaluation system includes aninterface system for transmitting detector data for image generation tothe evaluation system. Typically, the detector data include informationabout the detected radiation. Typically, the detector data also includeinformation about the position and/or orientation of the detector. Theinterface system can be an interface system for continuouslytransmitting detector data to the evaluation system. The evaluationsystem further includes a program memory portion with a program forregistering detector data with compatible data.

In further embodiments, the compatible data are detector data. Accordingto further embodiments, the evaluation system further includes a programmemory portion with a program for generating simulation detector databased on a base image. In further embodiments, the compatible data aresimulation detector data. According to further embodiments, the programfor registering is programmed to register detector data with compatibledata by means of at least one comparison function.

According to further embodiments, the evaluation system further includesa program memory portion with a program for indirectly registering thesimulation detector data with detector data by means of secondcompatible data. The second compatible data can be detector data. Thesecond compatible data can be second simulation detector data based on asecond base image.

The comparison function can for example be comparison functions asdescribed above or other comparison functions. Further, the base imageor the second base image can have the same or similar properties as theones described above.

Embodiments of the invention also include registering images. Theseimages can for example be generated from detector data or from otherdata sets. A registration of images can, for example, take place bymaximizing the similarity or minimizing the dissimilarity of bothimages. For the minimization of the dissimilarity or maximization of thesimilarity, comparison functions can be used such as cross correlations,trans-information, block entropies, cross correlation rates, cosinemeasure, extended Jaccard similarity, ratio image uniformity, sums ofsquared distances or sums of absolute values of distances. Otherinformation theoretic comparison functions may also be used. For theminimization or maximization process itself, optimization algorithms canbe used with algorithms as the ones mentioned above or others. Imagescan also be registered point-wise. To this end, specifically chosenpoints in both images are set into relation. The selection can takeplace automatically or interactively. Algorithms for point-wiseregistration can for example be the Umeyama or the Walker algorithm.

Finally, also an indirect image registration is possible. In this case,the process includes registering a third image with a second image,registering a first image with a third image, and registering the firstimage with the second image using the registration of the first imagewith the third image. The images can be for example anatomical orbody-functional images as in the case of the registration of data sets.Such images can be gained from detector data. The image can also begained from other detectors of the detection system such as for exampleby means of computer tomography, magnetic resonance tomography,ultrasonic sonography, picture taking of an optical camera or of anx-ray device. Examples for organ-functional images are images gainedfrom the detector data but also positron emission tomography, short PET,single photon emission computer tomography, short SPECT, or opticaltomography.

According to further embodiments, a method for image generation includesgenerating a first image on the basis of a collected detector data bymeans of the evaluation system. In further embodiments, the methodfurther includes a registration of the first image with the secondimage. For registering the first image with the second image, aminimization of the dissimilarity or a maximization of the similaritycan be used. In some embodiments, a comparison function is used for theminimization or maximization. Comparison functions can be the oneslisted above or other comparison functions.

According to further embodiments, a method for image generation includesregistering a third image with a second image, registering the firstimage with a third image, registering the first image with the secondimage by means of registering the first image with a third image.

In some embodiments, the second image is an anatomical image. In otherembodiments, the second image is a body-functional image. An anatomicalimage can be one of the anatomical images described above or be adifferent anatomical image. A body-functional image can be abody-functional image as described above or be a differentbody-functional image.

Quality Control

To provide high quality, in particular up-to-date high quality images,embodiments of the invention provide methods and devices for qualitycontrol of the detector data as well as of the generated images. In someembodiments quality control takes place continuously. In this way, thequality and validity of a generated image is checked. In furtherembodiments, the quality control takes place already during thedetection period.

FIG. 12 shows a typical process of quality control according toembodiments of the invention. A time axis 620 is shown, symbolizing thecourse of time (from left to right). In FIG. 12, a detection period 622is further shown. Further, with respect to the same time axis, a qualitydetermination period 624 is depicted. Typically, the qualitydetermination period 624 starts after the start of the detection periodwhen detector data are already available. The quality determinationperiod 624 can end before the detection period, at the same time as thedetection period or after the detection period. Typically, the qualitydetermination period 624 ends after the detection period. The distancesbetween marks on the line symbolizing the quality determination period624 symbolize themselves periods in which a quality determinationprocess takes place, such as for example determination of a qualityvalue by the evaluation unit. The distances 626 and 628 symbolize thefirst, respectively the last, quality determination process. In furtherembodiments of the invention, an alert signal 629 is output if datagathered, respectively collected, by the evaluation unit do not passquality control. Such a warning signal can be output for exampleacoustically, optically, haptically or by combinations thereof. Such awarning signal can make a user, for example a surgeon, be aware that theimages determined from the detector data may not be reliable at least atthe instance of time of the output of the warning signal.

Quality control is typically carried out on the basis of at least onequality criterion. With respect to one or more quality criteria, aquality value is calculated. Also, several quality values can becalculated for one, respectively more, quality criteria, for example ifa quality value is determined that depends on a respective imagingregion. Therein, for example, the validity or quality of an image can berejected if such a quality value does not fulfil one ore more qualitycriteria, i.e. does not satisfy them. Conversely, an image can beregarded as valid if a quality value satisfies a quality criterion orsatisfies several quality criteria. Here and in the following, an imagecan also be understood as a specified imaging region associated to therespective quality value.

Examples for a quality criteria are the following: the similaritybetween a first and a second image, wherein one of the images or both ofthe images may be generated from detector data; the conditioning of animage generation rule for generating an image; the relevance of data,such as detector data, for an image element; the plausibility of theimage generation from data, such as detector data or data from a secondimage; the uniformity of data, such as detector data; or the risk offalse generation because of faulty data, such as detector data.

The similarity between a first and a second image can be determinedsimilarly as in the case of registration. In particular, alreadyregistered images can again be compared with each other for similarity.The images can therein have been registered by direct image registrationor by data registration. The images can for example be anatomical ororgan-functional images as the ones described above, or others.

If the image generation rule is, according to some embodiments, a linearrule the conditioning of the image generation rule can be given by theconditioning of the imaging matrix or the system matrix. In particular,in a linear, discrete case, the conditioning number of the imagingmatrix H (see above) can be calculated. A conditioning number can becalculated by analysis of the spectrum of the singular values of thematrix or by similar matrix decomposition measures (for example relationof largest to smallest eigenvalue or number of eigenvalues being aboveor below a threshold value). In this example, the quality criterion is athreshold value for the conditioning number. If the calculatedconditioning number, i.e. a quality value, is smaller (respectivelylarger, depending on the definition of the conditioning number) then thethreshold value, the data, such as detector data, do not fulfil thequality criterion, and therefore an image generated therefrom isrejected. If, on the other hand, the calculated conditioning number islarger (respectively smaller) then the threshold value, the quality ofthe data, such as detector data, and an image reconstructed therefromare accepted.

Similarly, the quantity named with the technical term sparsity of amatrix row or of a matrix column can be a quality value, and a thresholdvalue with respect to this quantity can be used as a quality criterion.A row or a column of a matrix is sparse if less than a number of entriesdetermined by the threshold value are different from zero (respectivelyfrom numerical zero, i.e., smaller than a given epsilon-threshold). If amatrix column is too sparse an image element depends on two fewmeasurements, and therefore a high risk of false generation exists forthis image element. If a matrix row is too sparse the measurement valueassociated with this row is responsible for two few image elements,which again may lead to a high risk or false generation.

Correspondingly, also the relevance of data for an image element can beused as a quality criterion. For a linear image generation rule therelevance of a row or column can for example be associated with athreshold value for the sum of all entries of the row or column.

The plausibility of an image generation for example takes into account aconstraint. Examples for constraints are the maximal amount ofradiation, the gradient of the sum of maximal radiation, minimalradiation, radiation associated to image elements that obviously cannotcontain radiation sources (for example regions filled with air), andothers. Depending on the degree of plausibility, a corresponding qualityvalue can be associated.

The uniformity of detector data is determined by the spatialdistribution of measurements. Uniform measurements are present if themeasurements are distributed uniformly around the region to bereconstructed. A measure for uniformity is formed by the deviation ofthe actual measurements from a completely uniform measurement. A qualitycriterion is formed by a threshold value with respect to thisuniformity.

In typical embodiments of the invention, a quality control based on thequality criteria named above, or on others, is carried out successively,preferably quasi-continuously (as shown in FIG. 12). In furtherembodiments the results of quality control is output to a user by theoutput system. In particular, as described above, the output can bevisual, acoustical or haptic. For example, the output can take place bya coarsening of the image resolution in the corresponding image region.Thereby, a user is prevented from putting false confidence into possiblyfaulty images. According to further embodiments of the presentinvention, a method for image generation by means of an image generatingapparatus is provided. The method includes detecting radiation by meansof a detector. Detecting can take place during a detection period. Theradiation can be nuclear radiation. The detector can be movable. Thedetector can be freely movable. The detector can be portable in thehand. The method further includes collecting detector data for imagegeneration by means of an evaluation system of the image generatingapparatus. In typical embodiments the detector data include informationabout the detected radiation. In further typical embodiments, thedetector data comprise information about the position and/or orientationof the detector. The method further includes determining at least onequality value from the collected detector data by means of theevaluation system. In typical embodiments the determination is arepeated determination or a continuous determination, typically duringthe detection period.

In further embodiments, the method includes again, repeatedly, orcontinuously collecting detector data for image generation by means ofthe evaluation system of the image generating apparatus, preferablyduring the detection period.

In further embodiments, the at least one quality value is determinedwith respect to at least one quality criterion. A quality criterion canfor example be the similarity between a first image generated from thecollected detector data and a second image, the conditioning of an imagegeneration rule for image generation from the collected detector data,the relevance of the collected detector data for an image element, theplausibility of image generation from the collected detector data, theuniformity of the collected detector data, or the risk of falsegeneration because of faulty detector data. Apart from these, furtherquality criteria may be used.

Further embodiments, the method includes outputting the at least onedetermined quality value to a user. Further, other embodiments includeoutputting a warning to a user if the at least one quality value doesnot fulfil at least one quality criterion. Outputting the quality valueor the warning can take place visually, acoustically, haptically, or bycombinations thereof.

In further embodiments, an image generating apparatus for imagegeneration is provided. The image generating apparatus includes adetector for a detection of radiation. The detector can be a detectorfor detecting radiation during a detection period. The detector can bemovable. The detector can be freely movable. The detector can bevariable in the hand. The detector can be nuclear radiation. The imagegenerating apparatus further includes an evaluation system. Theevaluation system includes an interface system for transmitting detectordata for image generation to the evaluation system. Typically, detectordata include information about the detected nuclear radiation.Typically, the detector data further include information about theposition and/or orientation of the detector. The evaluation systemfurther includes a data memory portion for storing the detector data.The evaluation system further includes a program memory portion with aprogram for determining at least one quality value with respect to imagegeneration from the detector data. The program can also be a program foragain, repeatedly, or continuously determining at least one qualityvalue with respect to image generation from the detector data. Therein,determining at least one quality value can take place during a detectionperiod.

In further embodiments, the interface system is an interface system foragain, repeatedly, or continuously transmitting detector data to theevaluation system. The transmission can take place during the detectionperiod. The detector data can include information about the detectedradiation. The detector data can also include information about theposition and/or orientation of the detector.

In further embodiments, the program for determining at least one qualityvalue is a program for determining, again determining, repeatedlydetermining, or continuously determining a quality value with respect toat least one quality criterion.

In further embodiments, the image generating apparatus for imagegeneration further includes an output system, which includes at leastone output unit. In further embodiments, the output unit is an outputunit for outputting the at least one determined quality value to a user.In further embodiments, the output unit or a further output unit is anoutput unit for outputting a warning to a user if the at least onequality value does not fulfil at least one quality criterion. The oneoutput unit or the other output unit can be output units forinstructions or warnings to the user in visual, acoustical, or hapticalform, or in combination forms thereof. The outputs can be combined withan instruction to a user for improving the quality value, as describedfurther below.

Enhancement of Image Generation

According to embodiments of the invention, methods and apparatuses forimage generation are provided in which the quality of image generationis enhanced. In typical embodiments, a quality is continuously enhanced.In particular, the quality can already be enhanced, or continuouslyenhanced, during the detection period.

In typical embodiments, the image generation takes place on the basis ofa linear image generation rule. This image generation can for exampletake place by applying an imaging matrix or system matrix H to a vectorf, wherein H and f have denotations explained above. The imagegeneration can, as described above, take place by comparison of theresult vector g=H*f with the detector data vector g_(measured)(respectively by equivalent methods). The image generation, also calledreconstruction, takes place by minimization of the distance between thevector g and the vector g_(measured) as a function of f, as describedabove.

An improvement of image generation can take place by different ways thatinclude: improving the starting value of vector f in the minimizationproblem, enhancing the image generation rule, in particular the imagematrix H.

As starting value for the minimization problem, a vector f_(start) canfor example be used, the contained information of which is derived froma given image, for example from a pre-operative anatomical ororgan-functional image. This helps to avoid getting a wrong solutionwhile solving the minimization problem (such as being trapped in a localminimum that does not correspond to the desired solution). Also, thecomputing time can be decreased because one starts with a nearly correctsolution already. In this way, a good solution of the minimizationproblem, i.e. a good image f, can be obtained with reduced effort.

An improvement of the imaging rule, respectively of the imaging matrixH, can in particular take place by calculating at least one qualityvalue, wherein the quality value is the same as in the quality controlof data described above, or can be a further quality value.Additionally, the imaging matrix H is modified while taking into accounta quality value. In particular, the imaging matrix H is modified in sucha way that the modified matrix H better satisfies one or several qualitycriteria.

For example, rows or columns can be eliminated which have beenrecognized as being too sparsely filled according to a threshold withrespect to the sparsity of a matrix. Likewise, rows or columns of theimaging matrix H can be eliminated which do not satisfy the criterion ofrelevance. Instead of pure elimination, such rows or columns can becombined, whereby also the corresponding image elements (entries of f),respectively detector measurement values (entries of g), arecorrespondingly combined.

The uniformity can further be improved, for example by combining thedetector data of neighbouring measurements such that rather uniformlydistributed effective measurements are obtained. By such combinations,the imaging matrix becomes smaller, and also for this reason thereconstruction is numerically better solvable.

On the other hand, information may be lost by such combination. Tocompensate the loss of information at least partially, a higher weightcan be attributed to the entries averaged from several values, whichtakes into account their higher statistical significance. For example,the contribution of such entries to the distance norm |•| can receive ahigher weight.

According to further embodiments, the following further methods are usedfor enhancing image generation:

Use of Surface Information

If the surface of the spatial region containing the radiation source isknown, possible mappings can be eliminated that contain informationabout image elements which do not lie within this surface. Inparticular, this surface can for example be the surface of the body of apatient. This surface can be scanned by a laser range scanner, a lasersurface pattern scanner, a laser pointer surface scanner, stereoscopiccamera systems, time-of-flight cameras and further surface capturingsystems.

Such surface information can also be determined on the basis of thegeometry of an object tracked by the tracking system and its trackedtrajectory: if an object cannot penetrate into the patients tissue, thenthe spatial areas traversed by this objet must be filled with air andcan hence not contain any radiation sources. In particular, this objectcan be formed by the detector itself or be integral with the detector.

Use of Anatomical Information

If, for example in the case of medical imaging, the anatomy in a regionof the generated image is known, constraints can be set on the basis ofthe knowledge of the anatomy and can be taken into account. A constraintcan for example be that body part such as bones or the air tube (which,for example with a certain tracer, cannot form nuclear radiationsources) cannot show any radiation activity. In this way, possiblemappings can be eliminated that would falsely ascribe a radiationactivity to such regions. Anatomical information can for example beobtained by anatomic images captured before. These can be registeredwith current data. Also, standard data can be used, for example fromanatomic atlases, which can also be registered with currently generatedimages. Anatomical information can also be presently obtained by furtherdetectors of the detection system, such as for example ultrasonicdevices, computer tomographs, radiographs, optical cameras, magneticresonance tomography devices, and others.

Use of further Radiation Detectors

The detection system can include further radiation detectors. Furtherdetector data can also be used for image generation. Further detectorscan be radiation detectors, in particular radiation detectors fornuclear radiation. The further detectors can be movable radiationdetectors. The further radiation detectors can also be fixed radiationdetectors. For instance, the table on which the radiation distributionlies may include a gamma camera. In further embodiments, floor, sealing,and/or wall-mounted detectors are used.

According to further embodiments, a method for image generation by meansof an image generating apparatus is provided. The method includesdetecting radiation by means of the detector of the image generatingapparatus. Detecting can take place during a detection period. Theradiation can be nuclear radiation. The detector can be movable. Thedetector can be freely movable. The detector can be handheld. The methodfurther includes collecting detector data for image generation by meansof an evaluation system of the image generating apparatus. Typically,the detector data include information about the detected radiation.Typically, detector data also include information about the positionand/or orientation of the detector. The method further includesdetermining an image generation rule by means of the evaluation systemon the basis of the collected detector data. The method further includesmodifying the image generation rule on the basis of at least one qualityvalue. In typical embodiments, the modification is a repeated orcontinuous modification of the image generation rule. Typically,modifying takes place during the detection period.

In further embodiments, the collection of detector data is an anew,repeated, or continuous collection of detector data. In furtherembodiments, the determination of an image generation rule is an anew,repeated, or continuous determination of an image generation rule.Typically, determining, again determining, repeatedly determining, orcontinuously determining takes place during a detection period.

In further embodiments, the at least one quality value is determinedwith respect to at least one quality criterion. Quality criteria can bethe same as the ones described in the section about the quality control,or can be further quality criteria. Further quality criteria can becriteria on the basis of constraints. Such constraints can consist ofusing surface information, anatomical information or other information.Also, use of further radiation detectors can be made, and thus furtherdetector data for modifying, again modifying, repeatedly modifying orcontinuously modifying the image generation rule can be used.

In further embodiments, an image generating apparatus for imagegeneration is provided. The image generating apparatus includes adetector for detecting radiation. The detector can be a detector fordetecting during a detection period. The detector can be movable. Thedetector can be freely movable. The detector can be handheld. Theradiation can be nuclear radiation. The image generating apparatusfurther includes an evaluation system. The evaluation system includes aninterface system for transmitting detector data to the evaluation systemfor image generation. Detector data typically also include informationabout the position and/or orientation of the detector. The evaluationsystem further includes a data memory portion for storing detector data.The evaluation system further includes a program memory portion with aprogram for determining an image generation rule on the basis of thecollected detector data. The evaluation system further includes aprogram memory portion with a program for modifying the image generationrule on the basis of at least one quality value. The modification istypically an anew, repeated, or continuous modification of the imagegeneration rule. The program for modifying, again modifying, repeatedlymodifying or continuously modifying the image generation rule is,according to typical embodiments, a program for modifying, againmodifying, repeatedly modifying, or continuously modifying the imagegeneration rule on the basis of at least one quality value during thedetection period.

In further embodiments, the interface system is an interface system foragain, repeatedly, or continuously transmitting detector data to theevaluation system. Typically the transmission is a transmission during adetection period.

In typical embodiments, the program for determining at least one qualityvalue is a program for determining at least one quality value withrespect to at least one quality criterion. Quality criteria can be theones described above in the section “quality control”, or can be otherquality criteria.

In further embodiments, the image generating apparatus further includesan output system with at least one output unit. In further embodiments,the output unit is an output unit for outputting the at least onedetermined quality value to a user. In other embodiments, the outputunit is an output unit for outputting a warning to a user if the atleast one quality value does not satisfy at least one quality criterion.Outputting a quality value or a warning to a user can take place invisual, acoustical, or haptic form, or in a combination form thereof.

Outputting an Instruction to a User

Embodiments of the present invention include outputting an instructionto a user. A user can be a human user. A user can also be another livingbeing. Alternatively, a user can also be an inanimate object, forexample a machine. In particular, typical embodiments include outputtingof an instruction to a user for further moving the detector independence on the detector data already collected. Typical embodimentsinclude a continuous instruction for detection on the basis of acontinuous quality control, which has been described above. The outputtakes place by means of the output system, in particular in optical,acoustical or haptic form, or by combinations thereof. Specifically,instructions for further movement of the detector are given in such away that, when followed, a quality of the collected detector data isimproved. Typically, instruction for further moving the detector independence of the collected data is output such that, if followed, thequality of the detector data is presumably enhanced the most.Instructions can for example take place in form of outputting an arrowpointing in the direction in which further measurements shall be made.

Typically, the calculation of the current quality or rating or validityof the collected detector data precedes the outputting of aninstruction, and also a calculation how the quality of the data wouldchange if further detector data were available, in particular detectordata with information about the detected radiation measured fromdifferent orientations or positions of the detector.

FIG. 13 shows iterative method steps according to embodiments of theinvention. One of the iterative steps is a movement of the detector. Intypical embodiments, a freely movable, for example carryable detector isused. After or during movement, detection 614 of radiation by thedetector takes place. Afterwards, or simultaneously, a collection 615 ofdetector data with information about the detected radiation is carriedout by the evaluation system. Typically, further detector data such asposition and/or orientation of the detector collected, normallysynchronized with the detector data with information about the detectedradiation. On the basis of the detector data, a determination 616 of aquality criterion takes place by the evaluation unit. Then, an output618 of an instruction to a user takes place. According to embodiments ofthe invention, the output 618 instructs a user to move the detector in away that a movement corresponding to the instruction leads to thesubsequent measurement of suitable detector data. Suitable detector dataare typically detector data that enhance image generation.

Typically, such a position and/or orientation of the detector is outputto the user that would presumably enhance the quality the most. Anoutput, for example in acoustical form, can be represented in form of anintensifying signal sound. An output in haptic form can, for example, bethe provision of a sensation of resistance or of being pulled. Thissensation can for example be effected by mechanical guidance or byelectrical stimulation of muscles or of the brain.

To compute the orientations and positions which presumably enhanceimaging, anatomical or organ-functional images can also be used.

According to further embodiments, a method for image generation by meansof an image generating apparatus is provided. The method includesdetecting radiation by means of a detector of the image generatingapparatus. Detection can take place during a detection period. Theradiation can be nuclear radiation. The detector can be movable. Thedetector can be freely movable. The detector can be handheld. The methodfurther includes collecting detector data for image generation by meansof an evaluation system of the image generating apparatus. Typically,detector data include information about the detected radiation.Typically, the detector data also include information about the positionand/or orientation of the detector. The method further includesoutputting an instruction to a user for further moving the detector independence of the collected detector data. According to typicalembodiments, the instruction relates to at least a part of the remainingdetection period.

According to further embodiments, the collection is an anew, repeated,or continuous collection of detector data. In further embodiments,outputting an instruction is again, repeatedly, or continuouslyoutputting an instruction to a user for further moving the radiationdetector. In typical embodiments, the outputting, anew outputting,repeated outputting or continuous outputting of an instruction to a userfor further moving the radiation detector includes outputting theposition and/or orientation of the detector that, if adopted by thedetector, would enhance image generation according to at least onequality value in a accordance with a prediction. Typically, thepositions and/or orientations are output, which, if assumed by thedetector, would most enhance image generation according to a qualityvalue in light of a prediction. Outputting can take place visually,acoustically, haptically, or by combinations thereof.

In further embodiments, an image generating apparatus for imagegeneration is provided. The image generating apparatus includes adetector for detecting radiation. The detector can be a detector fordetecting radiation during a detection period. The detector can bemovable, freely movable, or handheld. The radiation can be nuclearradiation. The image generating apparatus further includes an evaluationsystem. The evaluation system includes an interface system fortransmitting detector data for image generation to the evaluationsystem. Detector data typically include information about the detectedradiation. Detector data typically also include information about theposition and/or orientation of the detector. The evaluation systemfurther includes a data memory portion for storing the detector data.The image generating apparatus further includes an output system foroutputting an instruction to a user how to further move the detector independence of the detector data. In typical embodiments, the instructionrelates to at least a part of the remaining detection period.

In further embodiments, the interface system is an interface system foragain, repeatedly, or continuously transmitting detector data to theevaluation system. In further embodiments, the output system foroutputting an instruction to a user is an output system for outputtingan anew, repeated, or continuous instruction to a user for furthermoving the detector in dependence of the detector data. Typically, theinstructions relate to at least a part of the remaining detectionperiod. In typical embodiments, the output unit is an output unit foroutputting the position and/or orientation of the detector which, ifassumed by the detector, would enhance, and preferably most enhance,image generation according to at least one quality value in accordancewith a prediction. The output unit can be an output unit for an outputin visual, acoustical, or haptic form or in a combination form thereof.

Freehand Acquisition

Intrinsic problems of processing detector data, which occur inparticular with a freely movable detector or a freehand detector, arisebecause measurements can take place in principle at each instant in timeand with arbitrary position and/or orientation of the detector. Thereby,data may be gathered while the detector is not pointed towards theradiation source that is to be detected. Similarly, further sources forunsuitable data exist. Such data can deteriorate image generation. Suchunsuitable data can deteriorate an imaging matrix, for example withrespect to relevance or sparsity.

FIG. 14 shows a freely movable detector 110 being moved along anarbitrary trajectory. The movement direction is indicated by arrowsalong the trajectory. Positions and orientations that follow in time toa first position and orientation are depicted with dashed lines. Thedetector 110 measures the emissions of a radiation source 10 within aspatial region 30 at different, generally arbitrary instances in time.The radiation source 10 can for example be a nuclear radiationdistribution in the body of a living being. FIG. 14 shows at least oneposition and orientation 630 of the detector which presumably leads tounsuitable detector data with respect to the measured radiation.Unsuitable detector data typically deteriorate image generation.

For this and other reasons, data acquisition with freely movabledetectors needs quality control even more than detection with fixed orlimitedly movable detectors. Besides quality control, an improvement ofthe image generation rule can take place.

According to embodiments of the invention, a quality control and/or anactive enhancement of the image generation rule takes place during thedetection period, in contrast to a post selection. In typicalembodiments, quality control takes place repeatedly or successively,typically quasi-continuously or continuously.

Likewise, the enhancement of an imaging rule can take place repeatedlyor successively, typically quasi-continuously or continuously. Anenhancement can take place as for example described in the section“enhancing image generation” or in another way.

According to further embodiments, a method for image generation by meansof an image generating apparatus is provided. The method includesdetecting radiation by means of a movable detector of the imagegenerating apparatus. Typically, detecting takes place during adetection period. The detector can be freely movable. The detector canbe handheld. The radiation can be nuclear radiation. The method furtherincludes changing the position and/or orientation of the detector. Intypical embodiments, changing the position and/or orientation of thedetector takes place during the detection period. Changing can be freelychanging the position and/or orientation of the detector. Changing canalso be again, repeatedly, or continuously changing. The method furtherincludes collecting detector data for image generation by means of theevaluation system of the image generating apparatus. Typically,collecting is again, repeatedly, or continuously collecting detectordata. Typically, collecting takes place during the detection period. Thedetector data usually include information about the detected radiation.The detector data usually also include information about the positionand/or orientation of the detector. The method further includesdetermining at least one quality value from the collected detector databy means of the evaluation system.

In further embodiments, determining at least one quality value takesplace again, repeatedly, or continuously, typically during the detectionperiod. In further embodiments, the at least one quality value isdetermined with respect to at least one quality criterion. Qualitycriteria can for example be the quality criteria described in thesection “quality control”, or can be other quality criteria.

According to further embodiments, an image generating apparatus forimage generation is provided. The image generating apparatus includes amovable detector for detecting radiation. The movable detector is,according to typical embodiments, a detector for detecting radiationduring a detection period. The detector can be freely movable. Thedetector can be handheld. The radiation can be nuclear radiation. Theimage generating apparatus further includes an evaluation system. Theevaluation system includes an interface system for continuouslytransmitting detector data for image generation to the evaluationsystem. Typically, detector data include information about the detectedradiation. Typically, detector data include also information about theposition and/or orientation of the detector. According to furtherembodiments, the interface system is an interface system forcontinuously transmitting the detector data during the detection period.The evaluation system further includes a data memory for storing thedetector data. The evaluation system further includes a program memoryportion with a program for determining at least one quality value withrespect to image generation from the detector data. According to furtherembodiments, the program for determining at least one quality value is aprogram for again, repeatedly, or continuously determining at least onequality value with respect to image generation from the detector data.In typical embodiments, the program for determining at least one qualityvalue is a program for determining, again determining, repeatedlydetermining, or continuously determining at least one quality value withrespect to image generation from the detector data during the detectionperiod.

In further embodiments, the program for determining at least one qualityvalue is a program for determining at least one quality value withrespect to at least one quality criterion. The at least one qualitycriterion can be a quality criterion as described in the section“quality control”, or can be a further quality criterion.

According to further embodiments of the invention, which can be combinedwith any of the embodiments, the method for image generation includesgenerating an image by minimization of the dissimilarity or maximizationof the similarity, wherein preferably at least one reconstruction methodfor minimization or maximization is used. The at least onereconstruction method can be an algebraic reconstruction method, shortART, a maximum likelihood expectation value maximization algorithm,short MLEM, an iterative matrix inversion method such as the Jacobimethod, the Gauss-Seidel method, or the over-relaxation method, a directmatrix inversion method such as the singular value decomposition or aregularised matrix inversion method such as the singular valuedecomposition with Tikhonov regularization.

According to further embodiments of the invention, which can be combinedwith other embodiments, the method for image generation is a method forimage generation for medical purposes. According to further embodiments,the method for image generation includes collecting body data of aliving being by means of the evaluation system. Typically, body datainclude respiration frequency and/or heartbeat frequency. Typically, thebody data also include data with respect to form, position and/ororientation of the body. In further typical embodiments, the body datawith respect to respiration frequency and/or heartbeat frequency aresynchronized with the body data with respect to form, position and/ororientation of the body, and are collected in synchronized way. Thegathering of body data of the living being can for example be effectedby the tracking system.

According to further embodiments, the method for image generationfurther includes modifying the image generation rule on the basis of thecollected body data. Thereby, movements of the body, for example byrespiration or heartbeat, can be taken into account for imagegeneration. This leads to an enhanced image generation. Also,registration of images or the registration of detector data isfacilitated thereby.

According to further embodiments, that can be combined with otherembodiments, the method for image generation includes gathering of dataof at least one instrument, preferably a medical instrument, by means ofthe evaluation system. According to further embodiments, the methodfurther includes a registration of data of medical instruments withrespect to data and/or simulation detector data by means of theevaluation system. In typical embodiments, the method further includesgeneration of a combination image on the basis of the registration.

According to further embodiments, the method further includes a trackingof data of medical instruments by the tracking system.

According to further embodiments, the method includes generating aninstrument image on the basis of the collected instrument data by meansof the evaluation system. According to further embodiments, the methodfurther includes a registration of the instrument image with the firstimage and/or the second image and/or the third image and/or with analready registered image. Further, the method typically includesgenerating a combination image on the basis of the registration.

According to further embodiments, the method includes outputting acombination image by means of the output system. According to furtherembodiments, the method includes instructing a user, on the basis of thecombination image, how to use the medical instruments. According to yetfurther embodiments, the method includes guiding a user while using themedical instruments by means of a guiding system on the basis of theinstrument data. The guiding system can include a guiding unit guiding auser in haptic, acoustic or visual way, or by combinations thereof.

In particular, instructing the user, on the basis of a combinationimage, on how to use the medical instruments, or guiding the user whileusing the medical instruments by a guiding system can take place forexample by visualization of a virtual reality, visualization of anaugmented reality, by layer and multi-layer visualization,frequency-modulated sound, amplitude-modulated sound, pulse-modulatedsound, by combinations thereof, or in any other way.

According to further embodiments, the method for image generationincludes positioning the living being. Positioning can take place forexample by a positioning system which includes a positioning unit. Sucha positioning unit can position the living being in any desired positionand/or orientation according to some embodiments.

According to further embodiments of the invention, the image generatingapparatus for image generation is an image generating apparatus forimage generation for medical purposes. According to further embodiments,the image generating apparatus includes at least one sensor fordetecting body data of a living being. Typically, the body data includerespiration frequency and/or heartbeat frequency of the living being.According to further embodiments, the image generating apparatusincludes a tracking unit for gathering body data of the living being.Typically, the body data include the form, position and/or orientationof the body. According to further embodiments, the evaluation systemfurther includes a program memory portion with a program forsynchronized collection of body data of the living being. Typically, theevaluation system further includes a data memory portion for storing thesynchronized body data of the living being. According to furtherembodiments, the evaluation system further includes a program portionwith a program for modifying the image generation rule on the basis ofthe collected body data.

According to further embodiments, the evaluation system of the imagegenerating apparatus further includes an interface for collecting dataof at least one instrument, typically of at least one medicalinstrument. Further, the evaluation system includes, according toembodiments of the invention, a program memory portion with a programfor generating an instrument image on the basis of the instrument data.

According to further embodiments, the evaluation system includes aprogram memory portion with a program for registering data of medicalinstruments with detector data and/or simulation detector data. Further,the evaluation system includes a program memory portion with program forgenerating a combination image on the basis of the output of the programfor registering the data of medical instruments according to someembodiments.

According to further embodiments, the evaluation system includes aprogram memory portion with a program for registering the instrumentimage with the first image and/or the second image and/or the thirdimage and/or with an already registered image. Further, the evaluationsystem typically includes a program memory portion with a program forgenerating a combination image on the basis of the output of the programfor registering the instrument image.

According to further embodiments, the output system of the imagegenerating apparatus includes an output unit for output of thecombination image. According to further embodiments, the output systemincludes an output unit for instructing a user how to use the medicalinstruments on the basis of the combination image. According to furtherembodiments, the image generating apparatus includes a guiding systemfor guiding the user while using the medical instruments on the basis ofthe instrument data. The guiding system includes at least one guidingunit.

The output unit for instructing a user how to use the medicalinstruments on the basis of the combination image as well as the guidingsystem for guiding the user while using the medical instruments cancommunicate signals to the user in haptic, acoustic, or visual form, orin a combination form thereof. The output unit can also be identicalwith the guiding unit of the guiding system. The output unit can also bedifferent from the guiding unit of the guiding system. The output unitand/or the guiding unit can be units for visualization of a virtualreality, for visualization of an augmented reality, for layer andmultilayer visualization, for frequency-modulated sound output, foramplitude-modulated sound output, for pulse-modulated sound output, orfor output of combinations thereof, or can be units for output in adifferent way.

According to further embodiments of the invention, the image generatingapparatus further includes a positioning system for positioning theliving being. The positioning system includes at least one positioningunit. In typical embodiments, the positioning unit can position theliving being in any desired position and/or orientation in space.

In the following some additional embodiments will be described(embodiments 1 to 30):

1. A device for intra-operative 3D-nuclear imaging, 3D-visualization andimage-guided surgery based on pre-operative data and tracked radiationdetectors, wherein the device includes: (a) a radiation detector; (b) atracking system for synchronously tracking the position and orientationof said radiation detector and for readout; (c) a pre-operative nuclearimage; (d) a data processing system which communicates with theradiation detector and with the tracking system and is adapted to readthe pre-operative nuclear image for allowing a three dimensionalreconstruction of the nuclear image and/or the computation of acorresponding quality value from a list of readout data, positions andorientations of the radiation device and the pre-operative nuclearimage; and (e) a display for displaying the reconstructed image.

2. A device for intra-operative three dimensional nuclear imaging,3D-visualization and image-guided surgery based on pre-operative dataand tracked radiation detectors, the device including: (a) a radiationdetector; (b) a tracking system for tracking the position andorientation of the radiation detector and of its readout data insynchronized form; (c) a pre-operative nuclear image; (d) a dataprocessing system which communicates with the radiation detector andwith the tracking system and is able to read the pre-operative nuclearimage for allowing the spatial registration of the list of readout data,positions and orientations of the radiation device; and (e) display fordisplaying the registered images.

3. A device for intra-operative three dimensional nuclear imaging, threedimensional visualization and image-guided surgery, based onpre-operative data and tracked radiation detectors as described in theembodiment 2 and also including a system for correct patient positioningbased on the output of the registration.

4. A device for intra-operative three dimensional nuclear imaging, threedimensional visualization and image-guided surgery, based onpre-operative data and tracked radiation detectors as described in theembodiments 1 and 2, and further including: (a) a three dimensionalimaging device; (b) a second tracking system which is the same as thefirst tracking system or which communicates with the first trackingsystem and is co-registered with it and determines the position andorientation of the three dimensional imaging device; and (c) a seconddata processing unit, which is the same as the first data processingsystem or which communicates with the first data processing system, andwhich communicates with the three dimensional imaging device and withthe second tracking system, thereby enabling to determine the positionand orientation of the body part that is imaged, and thus to calculatethe relative position and orientation of the body part that is imagedand the radiation detector and to allow a movement and deformationcompensation; and or to allow attenuation and/or scattering correctionbased on the three dimensional images.

5. A device for intra-operative 3D-nuclear imaging, 3D-visualization andimage-guided operation, based on pre-operative data and trackedradiation detectors as described in embodiment 4, wherein the threedimensional imaging device is of such form that it generates for exampleultrasonic images, x-ray based images, magnetic resonance tomographyimages, optical images, contrast-enhanced ultrasonic images,contrast-enhanced x-ray-based images, functional magnetic resonancetomography images, dye-based optical images, fluorescence images,reflection images, auto-fluorescence images, etc.

6. A device for intra-operative three dimensional nuclear imaging, threedimensional visualization and image-guided surgery, based onpre-operative data and tracked radiation detectors as described in theembodiments 1 or 2, further including: (a) artificial markings which arepositioned on or in the body part to be images; and (b) a secondtracking system, which is the same as the first tracking system or whichcommunicates with the first tracking system, and which determines theposition and orientation of the artificial markings and communicateswith the data processing unit, such that it allows to calculate theposition and orientation of the body part that is imaged and of theradiation detector and allows movement and/or deformation compensation.

7. A device for intra-operative three dimensional nuclear imaging, threedimensional visualization and image-guided surgery, based onpre-operative data and tracked radiation detectors as described in theembodiments 1 or 2, and also including a calibrated sensor formonitoring the position and orientation of the body part that is imaged,wherein the sensor communicates with the data evaluation unit, such thatit allows to calculate the relative position and orientation of the bodypart this is imaged and of the radiation detector and allows movementand/or deformation compensation.

8. A device for intra-operative 3D-nuclear imaging, three dimensionalvisualization and image-guided surgery, based on pre-operative data andtracked radiation detectors as described in the embodiments 1 or 2, andalso including a sensor for monitoring the respiration and a heartsignal of the patient, wherein the sensor communicates with the dataprocessing unit, such that a phase label is attached to each readout,position and orientation of the radiation detector, such that movementand/or deformation compensation for respiration, heartbeat, or both ispossible.

9. A device for intra-operative 3D-nuclear imaging, 3D-visualization andimage-guided surgery, based on pre-operative data and tracked radiationdetectors as described in any of the preceding or following embodiments,further including: (a) at least one surgical instrument and (b) a thirdtracking system for tracking the surgical instrument, wherein the thirdtracking system is the same as the first tracking system or communicateswith a first tracking system, such that the relative position andorientation of the surgical instrument and of the reconstructed threedimensional image or registered pre-operative image can be calculatedand can be used for (a) guiding instruments to regions of increasedaccumulation; (b) guiding instruments away from regions of increasedaccumulation; (c) guiding instruments to regions of low accumulation;(d) guiding instruments away from regions of low accumulation; (e)simulating, at the tip of each instrument, the radiation readout thateach instrument would give if it were a gamma probe; (f) displayingsurgical instruments on the display; and/or (g) detecting when thevalidity of the images is lost because of the operation in thereconstructed or registered volume by means of the instruments, andwarning a surgeon.

10. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, further including: (a) a display of virtual reality and/or(b) a display of augmented reality, such that the reconstructed3D-gamma-emitting images and the registered pre-operative images can bedisplayed three dimensionally in visual, acoustic, haptic or in acombined way, and/or in particular spatially registered with the imagegeometry of some camera, wherein the camera includes laparoscope camerasand cameras based on surgical microscopes, optical and image-transparenthead-mounted displays, optical and image-transparent, stereoscopicsurgical microscopes, optical and image-transparent displays.

11. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or any of thefollowing embodiments, wherein the radiation detector is one of thefollowing: gamma probe; beta probe; gamma camera; beta camera; minigamma camera; or a combination thereof.

12. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or any of thefollowing embodiments, wherein the tracking systems are externaltracking systems, for example including optical tracking systems,magnetic tracking systems, mechanical or robot arm-based systems, radiowave-based tracking systems, sound wave-based tracking systems, etc., orinternal tracking systems, which for example include accelerationdetector-based tracking systems, potentiometer-based tracking systems,etc., or a combination of external tracking systems and/or internaltracking systems.

13. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors as described in any of the preceding or any of thefollowing embodiments, wherein the displays are the following: (a)visual displays, for example monitor systems, which for example include:monitors, optically transparent monitors, stereo monitors,stereo-optically transparent head mounted displays, etc.; (b) acousticaldisplays, which for example include frequency-coded feedback systems,pulse-coded feedback systems, etc.; (c) haptic displays, which forexample include force feedback joysticks, force-torque feedbackjoysticks, etc., or (d) some combination of visual, acoustical and/orhaptic displays.

14. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, further including: (a) a memory system for the involvedinformation, which communicates with a first and second data processingunit and/or (b) a third data processing unit, which communicates with afirst and second data processing unit, such that the full information ora part thereof is stored as documentation material and/or an automaticreport of the procedure is generated.

15. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors substantially as described herein and with referenceto and/or as illustrated in the appended drawings.

16. A device for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, and further including a sensor and/or a further dataprocessing unit, which can be the same as the first data processing unitor can communicate with a first data processing unit for the onlinecalculation or the tracking of errors in the position and orientation ofany of the tracked objects and/or errors in the readout of the radiationrecord.

17. A method for intra-operative, 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors, including: (a) detection of radiation by means of aradiation detector; (b) synchronized tracking of the position andorientation of the radiation detector and its readings; (c) readout ofat least one pre-operative nuclear image; (d) 3D-reconstruction of anuclear image from a list of readings, positions and orientations of theradiation device and of the pre-operative nuclear image and/or thecomputation of a corresponding quality value; and (e) displaying thereconstructed image.

18. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors, including: (a) detection of radiation by means of aradiation detector; (b) synchronized tracking of position andorientation of the radiation detector and its readings; (c) readout ofat least one pre-operative nuclear image; (d) spatially registering alist of readings, positions and orientations of the radiation device;and (e) displaying the registered image.

19. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors as described in the embodiment 16, wherein theregistration is successful by back projection of the readout data,positions and orientations of the radiation detector on a 3D-radioactivedistribution.

20. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors as described in embodiment 16, wherein theregistration is successful by forward projection of the pre-operativenuclear image on the positions and orientations of the radiationdetector.

21. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided operation, based on pre-operative data and trackedradiation detectors as described in embodiment 16, further including:(a) correctly positioning a patient based on the output of theregistration; and/or (b) adaptation of surgery plans, wherein the outputis used.

22. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in the embodiments 15 or 16, furtherincluding: (a) generation of 3D-images by using 3D-imaging devices; (b)synchronized tracking of position and orientation of the 3D-imagingdevices; (c) determination of position and orientation and/or of thedeformation of the body part that is imaged from the 3D-images; (d) thecalculation of relative positions and orientations and deformations ofthe body part that is imaged and of the radiation detector; (e) thecompensation of movement and/or deformation of the body part that isimaged on the basis of this relative position and orientation and/orcompensation of the attenuation and/or scattering based on 3D-images.

23. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in the embodiments 15 or 16, furtherincluding: (a) monitoring the position and orientation and/ordeformation of the body part that is imaged by use of a calibratedsensor; (b) computation of the relative positions and/or orientationsand/or deformation of the body part that is imaged and of the radiationdetector; and (c) compensation of movement and/or deformation of thebody part that is imaged based on this relative position andorientation.

24. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in the embodiments 15 or 16, furtherincluding: (a) using artificial markings positioned on or in the bodypart that is imaged; (b) tracking the position and orientation of theartificial markings; (c) determining the position and orientation of thebody part that is imaged based on the position and orientation of theartificial markings; (d) calculating the relative positions andorientations of the body part that is imaged and of the radiationdetector; and (e) compensation of the movement and/or deformation of thebody part that is imaged based on this relative position andorientation.

25. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in the embodiments 15 or 16, furtherincluding: (a) monitoring the respiration and the heart signal of thepatient by means of a sensor; (b) determination of a phase for eachreading, position and orientation of the radiation detector; (c)compensation of the movement and/or deformation because of respiration,heartbeat, or both based on these phases.

26. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, further including: (a) using at least one surgicalinstrument; (b) determining the relative positions and orientations ofthe surgical instruments and of the reconstructed 3D-image or registeredpre-operative image; (c) using this relative position and orientationfor (1) guiding instruments to regions of enhanced accumulation, (2) forguiding instruments away from regions of enhanced accumulation, (3) forguiding instruments to regions of low accumulation, (4) for guidinginstruments away from regions of low accumulation, (5) for simulating,at the tip of each instrument, the radiation reading which would begiven if each instrument were a gamma probe, (6) displaying surgicalinstruments on the display, and/or (7) for detecting and for warning asurgeon when the validity of the images is lost by the operation in thereconstructed and registered volume by means of the instruments.

27. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, further including: (a) displaying reconstructed images orregistered pre-operative images either visually, acoustically, orhaptically, or in a combined way in 3D, and/or in particular spatiallyregistered with the imaging geometry of each camera.

28. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, further including: (a) a memory system for the fullinformation or a part thereof for documentation purposes; and/or (b)generating an automatic report of the procedure.

29. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors as described in any of the preceding or followingembodiments, further including: (a) online computation or tracking oferrors in the position and orientation of any of the tracked objectsand/or of the error in the reading of the radiation display; and (b)displaying the error for a signing a level of confidence to the readingsand/or compensating the error for using the gathered informationaccording to the level of confidence, and consequently to be able tocorrect the error.

30. A method for intra-operative 3D-nuclear imaging, 3D-visualizationand image-guided surgery, based on pre-operative data and trackedradiation detectors substantially as described herein and with referenceto/or as illustrated in the appended drawings.

In the following yet further additional embodiments are described(further embodiments 31 to 51):

31. A device for reliable intra-operative 3D-tomographic nuclearimaging, 3D-visualization of radioactive spatial distributions andimage-guided surgery by use of radiation detectors, wherein the deviceincludes: (a) a radiation detector; (b) a tracking system for trackingthe position and orientation of the radiation detector in a synchronizedway; (c) a first data processing unit which communicates with theradiation detector and the tracking system and which is able to evaluatethe quality of the gathered data and to determine the necessaryprojections for reliable 3D-reconstructions; (d) a second dataprocessing unit which communicates with the radiation detector and thetracking system and which is able to carry out a 3D-reconstruction basedon the readings of the radiation detector and the correspondingpositions and orientations; (e) a display that communicates with thedata processing unit and is able to display the necessary projectionsfor a reliable reconstruction to a surgeon and/or for guiding him; (f) asecond display that communicates with the data processing unit and isable to display the valid reconstructed 3D-gamma emitting images to asurgeon and to thereby allow to guide him/her to improve themeasurement.

32. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors, according to embodiment 31,wherein the first and second data processing units are the same orcommunicate with each other.

33. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors, according to embodiment 31,wherein the first and second display are the same or communicate witheach other.

34. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to embodiment 31,wherein the radiation detector is one of the following: gamma probe,beta probe, gamma camera, beta camera, mini gamma camera, or acombination thereof.

35. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to embodiment 31,wherein the tracking system is an external tracking system, which forexample includes an optical tracking system, magnetic tracking system,mechanical or robot arm-based tracking system, a radio wave-basedtracking system, a sound wave-based tracking system, etc. or an internaltracking system, which for example includes an accelerationdetector-based tracking system, a potentiometer-based tracking system,etc., or any combination of an external tracking system and/or internaltracking system.

36. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to embodiment 31,wherein the display is one of the following: (a) a visual display, forexample a monitor system, for example including: monitors and opticallytransparent monitors, stereo monitors, stereo-optical transparenthead-mounted displays, etc.; (b) an acoustical display, for exampleincluding frequency-coded feedback systems, pulse-coded feedbacksystems, etc.; (c) a haptic display, for example including forcefeedback joysticks, force-torque feedback joysticks etc., or (d) acombination of visual, acoustical and/or haptic displays.

37. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors, including: (a) synchronizedcollection of readout data of the radiation detector and of the positionand orientation of the radiation detector; (b) evaluation of the qualityof the collected readout data, positions and/or orientations; (c)calculation of the necessary set of projections, which are needed toallow a reliable 3D-reconstruction; (d) displaying the set or a subsetthereof or the information enabling to guide the surgeon to record theneeded projections; (e) 3D-reconstruction of a valid 3D-gamma emittingimage and/or the calculation of a corresponding quality value.

38. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to embodiment 31,including: (a) at least one surgical instrument; and (b) a secondtracking system for tracking surgical instruments, wherein the secondtracking system is the same as the first tracking system or communicateswith the first tracking system, such that the relative position andorientation of the surgical instruments and of the reconstructed valid3D-gamma emitting image can be calculated and can be used for (a)guiding the instruments to regions of high accumulation, (b) guiding theinstruments away from regions of high accumulation, (c) guiding theinstruments to regions of low accumulation, (d) guiding the instrumentsaway from regions of low accumulation, (e) simulating, at the tip ofeach instrument, the radiation reading which would be given if eachinstrument was a radiation detector, (f) displaying surgical instrumentson the display and/or (g) detecting and warning a surgeon, if thevalidity of the images is lost because of the invasion in thereconstructed volume by means of the instruments.

39. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to embodiment 35,wherein the relative position and orientation of surgical instruments isused for (a) guiding the instruments to regions of high accumulation,(b) guiding the instruments away from regions of high accumulation, (c)guiding the instruments to regions of low accumulation, (d) guiding theinstruments away from regions of low accumulation, (e) calculating theradiation readings that surgical instruments at their given positionsand orientations would measure if they were used as radiation detectors,(f) displaying the surgical instruments in co-registered form with thereconstructed valid 3D-gamma emitting images on the display, and/or (g)for detecting and for warning the surgeon if the validity of the imagesis lost by the invasion in the reconstructed volume by means of theinstruments.

40. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to any of the precedingor following embodiments, further including: (a) a sensor for monitoringthe respiration and the heart signal of a patient, wherein the sensorcommunicates with a data processing unit; (b) a sensor for determiningthe position and orientation and/or the deformation of the part of thebody which is imaged with the system that communicates with a dataprocessing unit, and/or (c) tracking markings placed on or in the bodypart that is imaged with the system and a third tracking system, whereinthe third tracking system is the same as the first or the secondtracking system or communicates with the first or second tracking systemor communicates with the data processing units, such that each readingof the radiation detector, of the position and orientation and/ordeformation can be calculated in the relation to the body part that isimaged or such that a phase label can be assigned to these with respectto the movement and/or the deformation cycles for allowing movementand/or deformation compensation in the reconstruction and/or thedisplay.

41. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to any of the precedingor following embodiments, further including: (a) monitoring therespiration or a heart signal of the patient, (b) monitoring theposition and orientation and/or the deformation of the body part that isimaged with the system, and/or (c) tracking the markings which areplaced on or in the body part imaged with a system such that eachreading of the radiation detector, position and orientation and/ordeformation can be calculated relative to the body part that is imaged,or such that a phase label can be assigned thereto with respect to themovement and/or the deformation cycle for allowing movement and/ordeformation compensation in the reconstruction and/or the display.

42. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to any of the precedingor following embodiments, further including: (a) a display of virtualreality and/or (b) a display of augmented reality, such that thereconstructed valid 3D-gamma emitting image can be displayed in 3D inacoustical, visual, or haptic way, or in a combined way, and/or inparticular spatially registered with the image geometry of any camera,including laparoscope cameras and cameras based on surgical microscopes,optical and optically transparent head-mounted displays, optical andoptically transparent stereoscopic surgical microscopes, optical andoptically transparent displays.

43. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to any of the precedingor following embodiments, further including: displaying thereconstructed valid 3D-gamma emitting image on (a) a display of virtualreality and/or (b) a display of augmented reality, such that the imagecan be displayed in 3D in visual, acoustical, haptical or in a combinedway, and/or in particular spatially registered with the image geometryof any camera, including laparoscope cameras and cameras based onsurgical microscopes, optical and optically transparent head mounteddisplays, optical and optically transparent stereoscopic surgicalmicroscopes, optical and optically transparent displays.

44. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to the embodiments 31,37, 39, or 41, further including: (a) at least one 3D imaging device anda fourth tracking system that determines the position and orientation ofthe imaging device, and which is the same as the first, second or thirdtracking system or communicates with these and/or (b) at least one portfor co-registered 3D-images, wherein the 3D imaging device, the fourthtracking system and the port for co-registered 3D-images communicateswith the first and second data processing unit, such that thereconstructed valid 3D-gamma emitting image can be displayed inco-registered way with the 3D-images and/or can be used to executeattenuation and/or scattering correction on the 3D-gamma emittingimages, which are for example ultrasonic images, x-ray based images,magnetic resonance tomography images, optical images, contrast-enhancedultrasonic images, contrast-enhanced x-ray based images, functionalmagnetic resonance tomography images, dye-based optical images,fluorescence images, reflection images, auto-fluorescence images, etc.

45. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to any of the precedingor following embodiments, further including: (a) co-registeredacquisition of anatomical or functional images that stem from at leastone 3D device and/or (b) use of previously acquired co-registered 3Dimages that stem from at least one 3D image generating device, such thatthe reconstructed valid 3D-gamma emitting images can be displayed inco-registered way with the 3D images and/or such that the 3D-gammaemitting images can be corrected with respect to attenuation and/orscattering by use of 3D images.

46. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery, preferably by use of radiation detectors, according to any ofthe preceding or following embodiments, further including: (a) a memorysystem for the involved information which communicates with a first andsecond data processing unit and/or (b) a third data processing unitwhich communicates with a first and second data processing unit, suchthat the full information or a part thereof are stored as documentationmaterial and/or an automatic report of the procedure is generated.

47. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors according to any of theembodiments 36, 38, 40, 42, or 44, further including: (a) storing theinvolved information and/or (b) automatically generating documentationmaterial.

48. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors as described in any of thepreceding or following embodiments, further including: a sensor and/or afurther data processing unit, which can be the same as the first dataprocessing unit or can communicate with the first data processing unit,for online computation or tracing errors in the position and orientationof each of the tracked objects and/or of the error in the readout dataof the radiation readings.

49. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors as described in any of thepreceding or following embodiments, further including: (a) onlinecalculation or tracing of errors in the position and orientation of eachof the tracked objects and/or of the error in the readout of eachradiation reading; and (b) displaying the error to assign a level ofconfidence and/or compensating the error to use the gathered informationaccording to the level of confidence and to thus be able to compensatethe errors.

50. A device for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors substantially as described hereinand with reference to and/or as illustrated in the appended drawings.

51. A method for reliable intra-operative 3D-nuclear imaging,3D-visualization of radioactive spatial distributions and image-guidedsurgery by use of radiation detectors substantially as described hereinand with reference to and/or as illustrated in the appended drawings.

While the forgoing is directed to embodiments of the invention, otherand further embodiments of the invention can be devised withoutdeparting from the scope of the invention set forth in the followingclaims.

1-181. (canceled)
 182. A method of image generation by an imagegenerating apparatus, comprising: detecting nuclear radiation by meansof a movable detector during a detection period; collecting detectordata for image generation by means of an evaluation system of the imagegenerating apparatus, wherein the detector data contain informationabout the detected radiation; repeatedly determining at least onequality value with respect to image generation from the collecteddetector data by means of the evaluation system during the detectionperiod; and outputting an instruction to a user for further moving thedetector in dependence of the at least one determined quality value,wherein the instruction relates to at least a part of the remainingdetection period.
 183. The method according to claim 182, wherein thedetector is freely movable.
 184. The method according to claim 182,wherein the detector is a free-hand detector.
 185. The method accordingto claim 182, further comprising: continuously collecting detector data,for image generation, by means of the evaluation system of the imagegenerating apparatus during the detection period.
 186. The methodaccording to claim 182, further comprising: outputting the at least onedetermined quality value to a user.
 187. The method according to claim182, further comprising: outputting an alert to a user if the at leastone quality value does not reach a threshold value.
 188. The methodaccording to claim 182, wherein outputting the instruction to the userfor further moving the radiation detector comprises outputting of such aposition and/or orientation of the detector which, if adopted by thedetector, would most enhance image generation in relation to at leastone quality value according to a prognosis.
 189. The method according toclaim 182, wherein outputting the instruction to the user and/oroutputting the at least one determined quality value to the user takesplace on an output system with at least one output unit in visual,acoustical, or haptic form, or by combinations thereof.
 190. The methodaccording to claim 182, further comprising: collecting body data bymeans of the evaluation system concerning respiration and/or heart beatof a living being, optionally comprising respiration frequency and heartbeat frequency, and/or, optionally, body data comprising form, positionand/or orientation of the body, wherein the body data with respect torespiration and/or heart beat are optionally synchronized with the bodydata with respect to form, position and/or orientation of the body; andmodifying an image generation rule on the basis of the collected bodydata.
 191. The method according to claim 182, further comprising:tracking data of medical instruments by means of a tracking system, andoptionally generating an instrument image on the basis of the collectedinstrument data by means of the evaluation system; and guiding the user,while using the medical instruments, by means of a guidance system onthe basis of the instrument data.
 192. An image generating apparatus forimage generation, comprising: a movable detector for detecting nuclearradiation during a detection period; and an evaluation system comprisingan interface system for transmitting detector data with information onthe detected nuclear radiation for image generation to the evaluationsystem, a data memory portion for storing the detector data, and aprogram memory portion with a program for repeatedly determining atleast one quality value with respect to image generation from thedetector data during the detection period; and wherein the imagegenerating apparatus further comprises: an output system comprising atleast one output unit, wherein the at least one output unit is an outputunit for outputting an instruction to a user for further moving thedetector in dependence of the at least one determined quality value,wherein the instruction relates to at least a part of the remainingdetection period.
 193. The image generating apparatus of claim 192,wherein the detector is freely movable.
 194. The image generatingapparatus of claim 192, wherein the interface system is an interfacesystem for continuously transmitting, for image generation, detectordata to the evaluation system with information about the detectedradiation and with information about the position and/or orientation ofthe detector.
 195. The image generating apparatus of claim 192, whereinthe at least one output unit comprises one output unit for outputting ofthe at least one determined quality value to a user and/or foroutputting an alert to a user if the at least one quality value does notfulfill at least one quality criterion.
 196. The image generatingapparatus of claim 192, wherein the at least one output unit comprisesone output unit for outputting such position and/or orientation of thedetector that, if adopted by the detector, would most enhance imagegeneration in relation to at least one quality value according to aprognosis.
 197. The image generating apparatus of claim 192, furthercomprising: a tracking system for gathering detector data about positionand/or orientation of the detector, wherein the tracking systemcomprises: at least one sensor for gathering body data about respirationand/or heart beat of a living being, optionally comprising respirationfrequency and/or heart beat frequency, and/or, optionally a trackingunit for gathering body data of a living being comprising form, positionand/or orientation of the body, and wherein the evaluation systemfurther comprises: an optional program memory portion with a program forcollecting the body data of the living being in synchronized manner, anda program memory portion with a program for modifying an imagegeneration rule on the basis of the collected body data.
 198. A methodfor image generation by means of an image generating apparatus,comprising: detecting radiation by means of a freely movable detector ofthe image generating apparatus during a detection period; changingposition and/or orientation of the detector during the detection period;continuously collecting detector data, for image generation, by means ofan evaluation system of the image generating apparatus during thedetection period, wherein the detector data comprise information aboutthe detected radiation and information about the position and/ororientation of the detector; and determining at least one quality valuefrom the collected detector data by means of the evaluation system. 199.The method according to claim 198, wherein the detector is a free-handdetector.
 200. An image generating apparatus for image generation,comprising: a freely movable detector for detecting radiation during adetection period; and an evaluation system, comprising: an interfacesystem for continuously transmitting detector data to the evaluationsystem with information about the detected radiation and withinformation about the position and/or orientation of the detector forimage generation during the detection period, a data memory portion forstoring detector data, and a program memory portion with a program fordetermining at least one quality value with respect to the imagegeneration from the detector data.
 201. The image generating apparatusaccording to claim 200, wherein the detector is a freehand detector.